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The work completed to date on the development and 
validation of a procedure for assessing the micro-environments of 
preschool children is summarized. It was speculated that the lack of 
evidence that compensatory programs facilitate developmental changes 
in children might be due to actual lack of influence by the nroyrams, 
to the subtlety of. *he influence, and/or the inappropriateness of the 
conceptual and analytical approaches to the data. The development, and 
validation of the procedure was guided by two sets of hypotheses: 
that adequately reliable and meaningful factors would emerge from a 
factor analysis of the micro-environment assessment data, and that 
tho factors would relate to post-test and change criteria, 
respectively, ’'he children were observed in their natural program 
environments and the data derived was reduced through factor analysis 
to individual child environment summary scores. Multiple regression 
analysis vas perforsed on this data and the above hypotheses were 
suooorted- Appendices include the observation recording sheet and 
data on the intercorrelations and/or factor loadings of 33 
environment items, 21 predictor variables, and 9 criteria variables. 
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The purpose of this report is to summarize work completed to date 
on the development and validation of a procedure for assessing the m ero- 
environments of preschool children. Micro-environment, as used in thl3 re- 
port, refers to (1) events which occur in the immediate environment of a 

child and which are sensorial ly accessible to him and (2) other setting 

# 

phenomena which act as a medium for a child’s behavior. 

The study addresses problems of conceptualization and assessment in 
regard to effects on»cblldreo of participation in compensatory preschool 
programs. To date, little evidence exists to support the conclusion that 
programs act to facilitate desired developmental changes in children. The 
lack of such evidence desplto considerable research may be due to (1) 
actual lack of influence, e.g. thu programs may be falling relntlvu U the 
task; (2) the Influence may be too subtle for assessment with existing 
measurement procedures i (3) the conceptual and analytic approaches may be 
inappropriate for handling data to adequately examine program influence. 

It is to the latter two concerna that this study la addressed. 

The following rationale guided *he development of tho study. Fince 
children in the sane molar environment often bring to bear different his* 
tories and expectations and, in addition, then encounter different experi- 
ences, it was felt that program encounters of a given child need to be 
determined. Procedures vhich document only some facets of the general 
environment ere not adequate to obtain this kind of data. Observations 
of an individual child am necessary and should Include documentation of 
how the child, hov the child uses hio environment , what contextual re- 
straints and facilities exist. 

Additionally, it vae believed that an analysis of program data should 
be undertaken relative to individual differences of children. It would 




-2 



be expected that If analysis is not done relative to individual child 
characteristics, that is, if all children within a given program are lumped 
together for analysis, interactions nay be cancelled out. The consequences 
of this concellation effect would be that fev significant differences could 
bo determined. And finally, 9ince it was believed that progron factors 
night be relevant for oome criteria but not for others, multiplu criterion 
neasures were thought necessary as part of procedure and prograa validation 
attempts. 

Thus, in the present study, observations were made of children in 
their natural program environments} the data derived va3 reduced via factor 
analysts to individual child (micro) environment summary scores. Theoo 
summary scores alonj with individual child pre-test data, were correlated 
with individual child post-test data cn several cognitive-verbal and per- 
formance-measures. 

The objectives, then, of this ctudy have been to (1) develop a 
methodology for sampling, observing, and recording encounters of preschool 
children in and with their Immediate environment and (2) analyse child 
change data so as to optiniie the- determination of interactions between 
Individual child variables and program cncour.ur9 a3 determined by the 
above micro-environment methodology. 

The following methodological hypotheses served to guide nrocodure 
development and validation! 

(1) Reliable determination of environmental data nay be obtained through 

sampled observations. 

(2) Program environmental data duriv^d from individual child observations 

will produce meaningful factors. 

(3) Factors determined will be related to child outcomes (i.e. post-test 
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(4) Predictive validation v’ill be greater when individual oubject and pro- 

gram environmental data arc included in contrast to cither child 
or program data when con3idored separately. 

(5) Program environment variables will contribute differently in rotation 

to different criteria. 

Procedure development and validation will be presented separately 
within the methodology, results, and discussion sections of this report. 

Methodology 

Sample 

The sample was drawn from children participating in Head Start 
classes in upstate Hew York during 1969-70. The four centers ia the 
area which had previously boon eolected for the National head Start Evalua- 
tion were included. The study sample consisted of eight children from 
each of ten classes. These eight subjects were selected from th03e child- 
ren in the class which were part of the national E and R sample and from 
which preteat data had been obtained. Fron that pool further random sel- 
ection W38 made under conditions of obtaining balance of sex and race. 

Table I shows the race and sex distributions for each sample class. 

Attrition brought the original sample of 89 subjects to 68. Sub- 
jects wets not used if there was lack of sufficient observational data 
(a minimum of thirty observations) due to excessive absenteeism or un- 
expected termination of a center program or if the subject terminated 
contact tilth the program prior to post-testing. 

Assessment ptocedut* 

Micro-environment assessment, per s e . .oneisied of three phases - 
sampling, observing and recording, and data reduction. 
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Table I 

Sample Race and Sex Distribution and 
Observer Assignment, by Class 
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Sampling . As the concern of micro-environment assessment was to (Jeter- 
nine the extent to vhich a target child (1) io impinged upon by his environ- 

nent and (2) uses his environnont as a medium for his behavior, and as each 

child participates in a program several hours a week, a method van required 
for sampling the encounters a child had uith his program. A minimum of 30 
four-minute observations were obtained for each of the subjects included 
in the 6tudy. 

Although Ideally these observations would have been randomly obtained 
across a specified program period, the expense of following this procedure 
would have been prohibitive. Therefore, a blocking schedule was used in 
which the eight subject children in each class were randomly placed into a 
schedule in two groups of four each which were observed in order by alter- 
nating observers. Observations were made on a given child no more frequently 
than every other day. The observing schedule, in addition, rotated the child 

run so that the first observation on a given day was not repeatedly made on 

thu same child. Observations were then made sequentially for the four 
children in a sampling block during the program day. 

Observing and recording . The observation procedure sampled tvo tvo- 
ftlnute periods with recording dono immediately aftor each tvo-minute period. 
The task of tht observer was to indicate whether an event occurred or not 
duting the two-minute observation time. In all cases Items were binary 
and non-contingent. That is, each item referent could potentially have 
been recorded as present during each observation. 

The first of the tvo-minute observations Included (1) the target f's 
physical location and posture; (2) focus and coordination of $’e behavior; 

(3) a writ tan and checklist indication of facets of the physical environ- 
ments encounteted - toys, people, equipment, etc.; (4) affective, other 
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vocal and verbal S behaviors; (5) affective, othor vocal and verbal behaviors 
of other children In the L'noedlato vicinity of the targot child] (6) Interper- 
sonal verbal and non-verbal encounters between any adult and the target S 
and any other child and the target Sj (7) conditions which night serve to 
qualify the accuracy of the observations] (8) behavioral Indicators of C 
ouch as ties, exaggerated gait, etc. 

The second two-ninute observation period Included (1) an Indication of 
the context of the chlld’o behavior, l.e, activity, his choice or not; (2) 
whether the class group was Intact or separated] (3) brief activity descrip- 
tion; (4) codes for targot child, peer, teacher, aide, and other adult ac- 
tivities - borrowed froo OSCl (Stern, 1968)] (5) nlninun distances between 
target child and others during the two olnute observation] (6) sanctions 
(coded) given by rdulto to children, Including the target child. Theee 
latter codes, along with Interaction codes referred to In the prior phase, 
were coded for dlrectedness which refers to vhethor the sanction was focused 
specifically on the target child, on the target child as a sub-group neabar, 
or as a neaber of the class. Thu recording sheet Is presented In Appendix A. 

Observers were sble to record froa 25 to 30 observations In a half 
day session] thus, when all children were present in the block being obser- 
ved, 6 to 7 observations per day could be aade for each child. Observations 
were thus sprasd over a ainuaua five-day period, ttien a child was absent he 
was added to the rotation schedule for the block to be oi served on hie next 
visit. 

Because of the vide distance between centers, observers ‘.rere hired 
froa local areas. Training was dona at the Syracuse Evaluation and fceeeerch 
Center and In the local centers. Ivx> observers were hired in etch of tvo 
centers and the writer and his assistant observed In the regaining two 
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centera, The assigranento of obeorvero to ceuters era presented In Table I. 
Training consisted of introducing tho observers, to the otudy and to the itaoe 
on vhlch discriminations rare to la made, allowing three daya of uomonltored 
practice vith tho codeo In the raopactlva canter Classen, and then monitor- 
lng of tho observers to check on correctness in item use*. 

Data reduction . Observation records wore date-time coded and trans- 
ferred to tally sheets. Data for each subject wero converted to proportions 
to adjust for differences in the total number of observations. Tho datum 
for the study thus consisted of the proportion of item occurrence! or base- 
rate. 

Item selection was necessary since vith 68 Re and a lover limit of a 2 
to 1 ratio of observations to dimensions! a mininun roquiruaunt for factor 
analysis! s oaxlmua of 34 items could be included. Thus, a priority system 
was established for selection of items to be Included in the preliminary 
factor analysis. The system placed high priority on "context" variablos and 
input to S variables, which showed variation between subjects. Moat. vari- 
ables included had a total base-rate which was more than 10X. 

Tht items Included vure grouped into one of threo sots - context to C, 

$ behavior - Indirect, and input to 8. Items included in each group arc as 
follovst 

Context to S . Cvnerai setting including physical and organisational, 
facste of the environment. 

1. Location! in main room - Child location, indoora, and in main 
room of program. 

2. Location i in other • Child location, indoors, and in other than 
main room of program. 

3. Support! floor - Child was physically supported by the floor. 

4 . Support! ground - Child v physically supported by the ground. 
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5. Support: furniture - Child was physically supported by furniture. 

6. Class intact - The class group (those of 15 children present) 
was Intact. 

7. Class separate - The class group vac separated; a part of the group 
was out of sight in another location. 

8. S choice/class - The S was allowed to choose his ovm activity. 

9. Teacher choice/class - The teacher or other adult present determined 
the S * 8 activity. 

S Behavior - Indirect . S behaviors which might possibly be a function 

of the setting and which might thus serve as 
an indicator of that setting. 

10. Locomotion: rapid - Child locomotion which was faster than walking. 

11. Coordination: non-regular - Wo more than ordinary coordination for 
behavior maintenance, e.g. body support, was manifested. For 
example, no large muscle coordination, no. eye-hand coordination, 
no verbal with physical movement coordination were observed. 

12. Persistence: involvement same - S behavior which was persistent, 
l.e. S was involved in the same activity for the entire two minute 
observation. 

13. Inaudible - A qualifier indicating that S spoke but could not be 
clearly heard. 

14. Affect: smile - Clear indication that the S sailed. 

15. Finger-mouth - S put or had finger in his mouth. 

16. Subject to peer: tells to do - S told a peer to do something. 



Input to S . A specific input occurred directly to S or in the immediate 
vicinity of S from adult or from members of the peer group. 

17. Group affect: giggle, laugh - Peer giggling and/or laughing 
occurred. 

18. Group affect: shriek, yell - Peer shrieking and/or yelling 
occurred. 

19. Group affect: cry, sob - Peer cryirig and' or subbing occurred. 

20. Group affect: loud talk - Peer loud talk occurred. 

21. Group affect: smile - Peer smiling occurred. 
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22. Group/Vocal-verbal/Non-af feet mouth sounds - Other non-affective 
vocal and or verbal behavior occurred. 

23. Adult to Si cills for attention - Adult calls for S attention. 

24. Adult to S: tells what doing - Adult tells what (o) he is doing. 

25. Adult to S: tails other to do - Adult telle someone (child) to do 

something. 

26. Sanction: involvement - Adult indicates that child should become 
involved in some activity. 

27. Sanction: location J Adult, indicated whore S should be located. 

20. Sanction: time - Adult indicated that it is or isn't (the right) 
time to be doing something. 

29. Sanction: posture - Adult indicated that a child's posture should 
be different than it is. 

30. Sanction: correct - Adult indicated that a task should or shouldn't 
be done in a given way. 

31. Sanction: nolao/motion * adult indicated that the activity level 
was too high. 

32. Sanction: fair share - Adult indicated that an equitable use among 
Ss of some finite resource should be made. 

33. Sanction: location-prop - Adult indicated where toys or materials 
should be placed and/or where belonged. 

As base-rotes were the prime data in this study, extent of agreement * 
between observers on base rate was used as an estimate of reliability. 

Table II shows reliability estimates for each observer pair and all the 
observers combined for; each of the 33 environmental items Included in the 
factor analysis. 

It chould be noted that the reliability estimate is based on the extent 
of agreement in base-rate for the given item for each subject. The relia- 
bility estimate is expressed a3 the percentage of agreement within 10 
percentage points. 

The 33 item-variables were subjected to factor analysis. A variraax 
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rotation factor analysis program developed by V&ldtnan ( ) produced seven 

factors. Factor scores (In the form of z scores) for each of the subjects 
were also provided by the program. These factor scores were Included as 
predictor variables In the multiple regrecolon analyses undertaken rela- 
tive to the criterion measures in the study. The factor analyses ( and 
the correlation matrix determined as the preliminary step) we re based on 
scores indicating proportion of occurrence of the behavior or event. 

Multiple regression analysis . A 3 tepwise (linear) regressing analysis 
(Veldman, ) was undertaken to determine the relationship between facets 
of a child's micro-environment, the child's pre-test scores on several cog- 
nitive verbal and performance measures, end the child's post-test scores 
on these same measures. 

The seven micco-environnent factor scores, three additional setting 
scores, one observation qualifier, three subject denographic indicators, and 
the seven pre-test scores made up the 21 independent (predictor) variables 
of the study. The seven post-test scores and the i:IA change socre were the 
criterion (dependent) variables. 

The three setting variables included were two indicators of the number 
of props encountered by S and :he number of days C actually attended the 
program. The first prop indicator was a minimum estimate (prop-Hln) of 
the number of toys, equipment, etc, S encountered and the second (prop- 
Max) war. a maximum estimate. The prop estimates were taken from observa- 
tional data and the attendance was from teacher records. The attendance 
data was not corrected for total number of program operation days. 

The total number of observations varied sufficiently (although for 




all subjects included there was a minimum of thirty) to warrant inclusion 
ae a potlntlal qualifier even though the conversion of micro-environment 
data to base-rates presumably corrected for possible differences. 
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the three demographic variables Included were S age (in months) 
at the time of pretesting, S ethnicity - Caucasian or Uegro, and S sex - 
male or female. 

Seven test scores were included as predictor and as the criterion 
variables. Pre-te6t scores served as predictor variables and post-test 
scores from the same tests served as criterion variables. The seven 
scores were derived from four tests individually administered as part of 
the Head Start Evaluation project. These were administered by the regular 
staff members of the Head Start Evaluation Center; observations were 
obtained by a separate staff. Two scores were derived from the Stanford- 
Binet - HA and IQ. One score (FR) was derived from a rating schedule com- 
pleted by the Stenford-Binet tester which noted factors adversely affecting 
test performance, The amount of time S took to complete the Caldwell 
Preschool Inventory was a fourth variable. Three scores vert derived from 
the Animal House subtest of the Wochslcr Intelligence Scale for Children 
(WPFSE) - tine for test completion in seconds, number of errors, time for test 
completion in seconds, number of errors, total raw score attained. 

An additional criterion score, HA change, was included. This socre 
was derived by subtracting the pre-HA from the post-HA. In all except throe 
cases the change was positive. The minuses (-1, -1, -2) change scores 
were low and were thus included as zeros. 

Results 

As assessment procedure development and validation are logically 
distinct phases, they are separately reproted here. 

Procedures development . 

T\k> hypotheses were associated with procedure development. The first 
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concerned the reliable determination of micro-environment data, and the 
second concerned the emergence of meaningful factors. 

Tablo XI shows the raw score means and standard deviations for the 
thirty-three environment items and the observer pair and total rellabilltlos 
associated with each. 

The means and standard deviations reflect an adequate amount of varia- 
tion between child sottingo and the reliabilities, while moderate, appear to 
be generally adequate. 

An examination of Table II would support confirmation of Hypothesis I 
that reliable determination of micro-environment variables could be obtained. 

Hypothesis II : Program environmental data derived from individual 
child observations will produce meaningful factors. Factor analyses of 
the environment variables produced seven factors, which accounted for 
76. percent of trace. Five of the factors appeared meaningful. Item 
contributions to each factor, factor descriptions and tentative names, 
are reported separately for each factor in the following sections, Intor- 
correlations of the thirty-three items are presented in Appendix B, and 
Appendix C shows the factor loadings of the thirty-three items for each of 
the seven factors. 

Factor I, which accounted for 30.820 percent of the total factor trace, 
appeared to reflect four themes: teacher domination, low affect in child- 

ren, divided class activities, and diverse settings. Teacher domination 
was evidenced by adult direction and many diverse sanctions. Low affect 
in the children was evidenced by negative loadings on group and C snil- 
lng, crying, talk. Divided and diverse activities were evidenced by items: 
Class; not Intact, Location (negative loading), Furniture (negative loading). 
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In addition Location-in/out/etc. did not load on this factor. The factor 
has been named Adult directed and highly controlled small group activities . 
Table III contains Item descriptions and loadings for this factor. 

Factor II, representing 14.266 percent of the total variance accounted 
for by the factors, has been labeled Diffuse Activity Structure . Although 
some items evidenced adult efforts to structure (Teacher choice; A to $- 
tells others to do; Sanction-posture), other Items seemed to represent a 
relatively unfocused situation (Coordination - none/regular; Locomotion, 
rapid; Inaudible; Persistence-Involved same (negative loading). The load- 
ing on affect Items would seem to reflect rather positive emotionality, 
l.e. positive loading on Gp affect-smile and Affect (S)-smlle along with 
negative loadings on Gp affect-cry/ sob and Gp affect-ohrieh/yoll. The 
combination of these items seetas to suggest a setting In which an adult 
structures a situation which Is noninvolving for the children. Item des- 
criptions and loadings are picsented in Table IV. 

Factor III represented 10.052 percent of total factor trace. Items 
Indicating activity In the Main room with an Intact class received substan- 
tial loading. The Item Support: furniture received positive loading and 
may be an Indication of sedentary activity. The negative loading on 
Inaudible and the appearance of the Item, Persistance: Involved same, 
are Indications of quiet Involvement. No items indicating teacher structur- 
ing or sanctioning and no items regarding emotionality appear. This factor 
has therefore been designated Undisrupted Independent Effort . Table V 
contains the Item loadings for Factor III. 

The loadings in Factor IV seem best labeled as Adult Tolerated Non- 
gettled Behavior . The factor accounted for 5.785 percent of the variance 
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TABLE III 

ROTATED FACTOR LOADINGS FOR 7 AC TOR I 



Item if 


Item Name 


Loading 


26 


Sanction-Involvement 


.871 


13 


Group-Loud Talk 


-.861 


10 


Group-Giggle /laugh 


-.852 


19 


Adult to S- tells what doing 


.820 


16 


Group- non-affect mouth sounds 


1 

* 

00 

o 

M 


18 


Adult to S- calls for attention 


.796 


33 


Sanction-location prop 


.766 


23 


Class-separate 


.764 


11 


Group-shriek/yell 


-.760 


30 


Sanction-correct 


.722 


28 


Sanction-time 


.670 


6 


Support-furniture 


-.651 


20 


A to S - tells other to do 


.635 


22 


Class-intact 


-.624 


5 


Support-groupd 


.616 


24 


S choice-class 


-.578 


12 


Group affect-cry/sob 


-.541 


29 


Sanction- posture 


.411 


31 


Sanction- noise, motion 


.344 


17 


Finger-mouth 


-.332 


25 


Teacher choice 


.321 
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TABLE IV 

ROTATED FACTOR LOADINGS FOR FACTOR II 



Item 0 


Item Name 


Loading 


25 


Teacher choice 


.,'785 


7 


Coordination-none/regular 


.775 


3 


Lo como t ion-r ap id 


.700 


24 


S choice 


-.569 


29 


Sanction-posture 


.593 


4 


Support-floor 


-.538 


9 


Inaudible 


.489 


18 


Adult to S-call8 for attention 


-.415 


15 


Group affect-smile 


.394 


20 


Adult to S- 'ells other to do 


.389 


12 


Group affect-cry/sob 


-.382 


14 


Affect (s) -smile 


.363 


8 


Persi6tance-involved same 


-.358 


11 


Group affect-shriek/yell 


-.301 



O 
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attrlbuted to all factors. The items Locomotion, rapid, Gp affect-cry/ 
sob, Gp affect-shriek/yell, Finger/oouth (negative loading) rather clearly 
reflect unsettled behavior. Items Support-floor and Support-furniture 
(negative loeding) may Indicate nonsedentary activity. Only one sanction 
item received any substantial loading Implying adult tolerance despite 
tno M unsettledne8s M 6ugge8ted by the above items. Item descriptions and 
loadings for Factor IV are presented in Table VI. 

Neither Factor V nor Factor VI seemed to have interpretable meaning 
and were therefore not named. Factor V accounted for 4.846 percent of the 
factor trace and Factor VI 6.238 percent Tables VII and VIII contain the 
item descriptions and loadlngo. 

Factor VII, although containing only three items receiving substan- 
tial loading, seems readily interpretable. The items reflect S character- 
istics and are seen as representing an involvement (Persistance-lnvolved 
same) in which the S is directing efforts to do something (S tells peer 
to do) and absence of Affect-smile. This factor has been called Subject- 
directed Striving . It accounts for 4.457 percent of factor trace, Items 
descriptions and loadings sre presented in Table IX. 

It will be noted from an examination of Tables III through IX that 
the first two factors are heavily weighted with Context to S items (i.o. 
setting, structure) and the latter factors are heavily weighted with 
S behavior as indirect indicators of the setting. Input to S items are 
somewhat scattered but more heavily evidenced in the first two factors. 

An examination of these tables lends support for the second hypothesis 
that meaningful factors will emerge from micro-environmental assessment. 
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TABLE V 

ROTATED FACTOR LOADINGS TOR FACTOR III 





J 


Item 


Loading 


2 




Location; In, other 


-,874 


i 




Locations In, oaln 


.800 


22 




Class Intact 


.651 


9 




Inaudible 


-.591 


8 




Persistences Invol sm 


.502 


6 




Supports furniture 


.340 


5 




Supports ground 


-.328 


23 




Class separate 
TABLE VI 


-.313 


ROTATED FACTOR LOADINGS FOR FACTOR IV 


Iteo 


6 


It eta 


Loading 


3 




Locomotion, rapid 


.828 


12 




Groups cry/ sob 


.574 


17 




Fingei /south 


-.358 


11 




Grcrjp! shrelk/yell 


.344 


6 




Supports furniture 


-.331 


4 




Supports floor 


.314 


27 




Sanctions location 


.309 




20 



tabu: vii 



ROTATED FACTOR LOADINGS FOR FACTOR V 



Item 0 


Iten nane 


Loading 


32 


Sanction-fair share 


.807 


17 


Finger-mouth 


.593 


8 


Poreiatance-invoivcd sane 


-.370 


27 


Sanction-location 


.324 



TABLE VIII 



ROTATLD FACTOR LOADINGS FOR FACTOR VI 



Item 0 


Item name 


Loading 


31 


Sanction-noise, motion 


-.756 


4 


Support-floor 


-.535 


5 


Support-ground 


.438 


29 


Sanction-posture 


.411 


1 


Location-in main room 


-.374 


23 


Adult to S-tells other to do 


.342 



TABLE LX 

ROTATED FACTOR LOADINGS FOR FACTOR VII 



Item # 


Item 




Loading 


22 


S tells Peer, 


to do 


.712 


14 


Affect; smile 




-.699 


6 


Persistence! 


Inv. sa 


.316 
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Procedure validation 

Hypothesis III. Factors determined will be related to child out- 
comes, i.e. post and change criterion measures. 

Table X shows the correlations between the seven factors and the 
post-teat and change criterion measures. Correlations between some add- 
itional predictor variables which had not been considered in the factor 
analysis and tne eight criterion measures are also reported in Table X 
for comparative purposes. These included three program variables - Ptrops- 
Mln, Props-Max, Days Attended: three subject demographic variables - Age, 
Ethnicity, and Scxj and tho S pre-test scores. (Intercorrolatlon9 among 
predictor variables aij reported in Appendix D and tho criterion inter- 
correlatlons are in Appendix E. Crltcrlor X's and CD's are shown in 
Appendix E.) 

An examination of Tablu X shows Factors 1, lit, IV, and VII signifi- 
cantly relate to the cognitive measures - mental age, 10 and Animal 
House score. Factor lit relates to a non-cognitivo criterion, time to 
complete the Animal House subtest nf the MPPSI. 

The three environmental variables (Prop-Kin, Prop-Max and days 
Attended) which ware not included in thw factor analysis are relevant 
to consider in regard to hypothesis lit. Prop-Kin was significantly 
related to tho Factors (FP.) score and PS1; Prop-Max was related to MA 
changa. 

The low order but eignlficant relationships between environmental 
indicators (both the factors and edded crop variables) tend to support 
Hypothesis tit. 

Hypothesis IV. Environmental indicators will contribute variance 
predictability on criterion test socres in a multiple correlational 
analysis. 




Title X 

Correlations of cvency-on- Predictor V.iriril-is rlth Ei.ch of Cev».n Crite-rion Viriibles 
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The results of a step-wise nultiplo regression analysis lent support: to 
Hypothesis IV. Multiple correlations and P tests between tho twenty-one 
predictors and the eight criterion variables arc presented in Tablu XI. 

It will be noted that all P's were significant with one exception, tb'a 
Adverse Factor's rating. 

Tables XII through XIX show thu iteration sequences for anch of the 
eight criterion tnea3uros separately. Each of the eight will be discussed 
in turn. It should be noted that the iteration sequence reflects increased 
contribution via different combinations of predictors, emulative se- 
quencing has not been presented in tho tables bayond the point where 
additional iterations failed to contribute an additional full (1) percent 
to criterion variance predictability. 

Criterion 1, Post 11A. Table XII shove tho Iterative sequencing of 
subject environmental predictors on the !IA score derived froo a post-test 
administration of the Stanford-BJnet. It will be not.d chAt "hilc thu 
pre-test MA accounts for fifty percent of the post-test score and the 
/jilaal Louse Error count predicts an additional six percent, the various 
environmental factors add even aore (approxiaately twelve percent when Days 
Attended is Included as an environmental variable). 

Criterion 2, Post IQ. Table XIII shows the iterative sequencing 
of subject and environmental predictors on IQ as derived froa the post 
Stanford-Binct testing. As would be expected, Mental Age-Pre predicts 
fifty percent of the post 10 variance, while t age and Errors on the 
Animal house are associated with an additional ten percent. Environmental 
actors contribute snail but persistent variance predictability. 

Criterion 3, Adverse Factors. Iterative Sequencing of subject and 
environmental predictors of th- post-test rating of Factors (Fit) adversely 
affecting test (Stanford-Blnet) performance are shown in Tatli XIV. 
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TABLE XI 



MULTIPLE CORRELATIONS (AilD II SQUARED) FOR 21 PREDICTOR 





AND EIGHT 


VARIABLES 


/AID F ’t 


i'ESTC 






Criterion 


R 


R SQ 


F- RAT IO 


P (exact)* 


1 . 


HA (post) 


.847 


.717 


5.425 


.0000 


2. 


IQ (post) 


.037 


.701 


5.026 


.0000 


3. 


FR 


.050 


.422 


1.568 


.1025 


4. 


PSI (time) 


.717 


.515 


2.272 


.0106 


5. 


/JI (tine) 


. C 70 


.44? 


1.747 


.0582 


0 . 


AH Errorc 


.775 


.600 


3.221 


.0007 


7, 


Al. Score 


.777 


• 004 


3,270 


.0006 


6 , 


ilA Change 


.700 


.488 


2.032 


.0230 



*Df '.I/D • 21/45 

TABLE XII 

ITtamvC GEQUEi'.CWG OF PREDICTOR VARIABLES OK 
MENTAL AGE (POET) CRITERION 

Predictor 



8 


Kant 


Type 


R SO 


11 


Mental Agv, prv 


F:tust 


.506 


10 


Anlnal llousa Atrors, pro 


Si tost 


.564 


20 


Days attended 


invir 


.5S8 


4 


Factor IV 


Lnvir 


.623 


1 


Factor 1 


Envir 


.635 


7 


Factor VII 


Er.vir 


.649 


5 


Factor V 


Envir 


.659 


6 


Factor VI 


Lnvir 


.668 


14 


Ptop Count-Ha* 


Envir 


.679 
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table mi 



ITERATIVE SEQUENCING OF PREDICTOR VARIABLES Oil 
IQ (POST) CRITERION 

Predictor 



9 


Nee*; 


Type 


R SQ 


11 


Mental Ago, pro 


Sstost 


.434 


10 


Ago 


Sidtruo 


.565 


18 


Aninal l.oust Etrora 


Sitcst 


.592 


7 


Factor VII 


Envlr 


.614 


4 


Factor IV 


Envlr 


.629 


14 


Prop Count (Max) 


Envlr 


.645 
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'fails the multiple correlation did not product i significant P it ie clear 
fron nn examination of Tible XIV that environnental variables are aihing 
contribution to tho variance accounted for. The Frop-Min count is par- 
ticularly noticcablu as are tho othjr subject and environmental variables 
from \faich one night infer perceptual-motor practice opportunity or 
con3oquuiicoe of opportunity to practice purceupt.il motor coordination, u.q, 
Animal House test, Factor III. Contributions fron total nunber of obser- 
vations are not readily intcrpretnble. 

Criterion A, Foot Preschool Inventor y-Tiou. Iterative sequencing 
of subject end environnontal predictors for PCI-Tine (mount of tine/nin. 
taken to conpluto the Cilducll Preschool Test) during tho post-tost admin- 
istration is contained in Table XV. It '.’ill be oot-:d that the uost effec- 
tive predictor is Factor III, an environmental variable. Another environ- 
mental predictor, Props-Min count, adds ton rercont to the predictive 
capacity. 

Criterion 5, Poat Animal house Tine. Iterative sequencing of subject 
and environmental predictors on the tine taken to complete the post-test 
administration if Animal House, is shon*n in Table XVI. Factor III, an 
environmental variable, is the best predictor of the post-tost score and 
other environmental variables account for additional variance. 

Criterion 6, Post «niajl House- Errors. Iterative sequencings for 
environmental and subject predictors on the nunber of errors nidu in tho post 
test administration of the ITFS1 subtest, Animal House, are presented id 
Table XVII. 'faile l variables contribute the majority of the v lance 
predictability, environmental variables continue to add snail nts. 

Criterion 8, M.A. change. Iterative Sequencing, of environmental and 
subject predictor variables on the difference in M.A. scores between pre- 
and post-testing, Is reported in Table XIX. T .1ill& the best predictor is 
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TAblB XIV 



ITERATIVE SEXJUEilCIWO OP PREDICTOR VARIABLE: OH 
FACTORS (POST) CRITERION 

Predictor 



* 


llw* 


Type 


r :q 


15 


Factors (pro) 


Ci rating 


.004 


13 


T rop-Uln 


Envir 


.175 


IS 


Ar.iool Kousu Errors (pro) 


Sitcst 


.247 


21 


Total f observations 




.283 


20 


Dnyo attended 


Envir 


.301 


3 


Factor III 


Envir 


.310 


17 


Aninnl House Tine (pro) 


fittest 


.335 


9 


Sox 


Sidcno 


.349 




TAHLli XV 

ITERATIVE Ct 1 UEHCIi'C OF PREDICTOR VARIABLES OF 
PS l TIME (POST) CRITERION 

Ivedictor 

s Mine Typo R SC 



3 Factor III . 
13 Frop-llln 
12 IC (pr») 

5 Factor V 
15 lectors 
4 Factor IV 
20 Diy9 Attended 
10 Ago 
12 IQ (or*) 



Envir 


.102 


Envir 


.285 


fittest 


. 322 


Envir 


.3C2 


Striting 


.3;e 


Luvir 


.423 


En\i- 


.442 


Stdooo 


.458 



StUit 



477 



..28 



TABLE XVI 

ITERATIVE SEQUENCING OF PREDICTOR VARIABLES ON 
ANIMAL liOUSL TIME (POST) CRITERION 

Predictors 



t 


None 


Typo 


R SQ 


3 


Factor III 


Lnvir 


.099 


11 


Mental age (pre) 


Si test 


.131 


4 


Factor Iv 


Envir 


.153 


0 


Sox 


Stdeoo 


.192 


21 


Total # observations 




.214 


12 


IQ (pre) 


Sitest 


.237 


5 


Factor V 


Envir 


. 263 


13 


Prop-Min 


Envir 


.281 


6 


Factor VI 


Envir 


.297 


17 


Aninal House Tine (pre) 


Sitest 


.308 


13 


Aninal House Errors (pro) 


Sitest 


.316 


3 


Factor III 


Envir 


.328 




TABLE XVII 



ITERATIVE SEQUENCING OF PREDICTOR VARIABLE? Oil 



/iMXIS/X 

Predictor 


HOUSE ERPvOR (POST) 
ilfifi 4> - 


CRITERION 

Typo 


R £0 


16 


Animal Kousu Errors (pro) 


S i tost 


.323 


11 


Mental Ago 


(pro) 


Si test 


.309 
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t;,ble XVIII 
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ANIMAL iOUSC PJ.V SCORE (POTT) CRITERION 
Predictor 



# 


_ llaau ... 


. . Tvnt 


R £0 


18 


Anioal Houses Errors (pro) 


Sitost 


.389 


7 


Factor VII 


Envir 


.434 


21 


Total i ovscrvatlona 




.449 


1 


Factor I 


Envir 


.462 


14 


Prop-Max 


Envir 


.476 


2 


Factor II 


Envir 


.502 


20 


Days attended 


Lnvir 


.517 


15 
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T/.3LE XIX 

ITERATIVE SEQUENCING OF PREDICTOR VARIABLES OH 
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the MA pre-t^st score, it is clear fron an examination of Table XXX that envi- 
ronmental variables contribute substantially to the total variance predicta- 
bility on this criterion. 

Examination of Tabled Xlli through XIX rovaala that varying contributions 
are raadu to criterion voriance predictability by environmental variables. The 
greater contributions are made to non-cognitive criterion measures e.g. 
adverse factors mating, tine taken to complete the Caldwell Preschool Inven- 
tory and Animal House, but noticeable contributions ar* made to cognitive 
criteria 33 wall. Although environmental contributions to criterion pre- 
dictability vary, there appears to be at least minimi support for Hypothesis 
IV. 

Hypothesis V. Environmental variables vill have differential oredictive 
capability among criterion variables. 

One aspect of validation is the capacity for differential prediction. 

Within this frame of reference, the question was asked as to whether the 
environmental factors which emerged from factor antnlysis would differentially 
predict po3t- and change criterion scores. Would a factor, which was indenen- 
dent of other factors predict one criterion and not another? 

An examination of Tables X through XIX lends support to Hypothesis V. 
Factors I, III, and VII appear related (in different v/ays) to copnitive 
measures and II and IV appear related (again in different vayo) to non-co°nitiv3 
measures. While no t^sts for contribution significance v;erv made for the 
multiple correlations, it i 8 clear from a cursory examination of these tsble 3 

k •* 

that varying contributions \ ere made. 

Summary of Results . 

Tvo sets of guiding hypotheses were: put forth concerning procadure devel- 
opment and procedure validation. 

Frocedure development. Adequately reliable and meaningful factors did 
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emorge from a factor analysis of the micro-environment assessment data. 

Procedure validation. The factors, in turn, did relate to post-test 
and change criteria. Specifically, the following factor-criterion rela- 
tionships were determined: 

Factor; Adult-directed and highly controlled stnall»-group activities 
correlated negatively with UA post-test scores. 

Factor; Undisrupted independent effort correlated regatively with 
amount of tine taken to complete the FSI and Animal Louse tasks. 

Factor; Adult tolerated non-settled (S) behavior correlated 
negatively vith !IA change. 

Factor; Subject-directed striving correlated positively with 
post-test HA and Animal Louse scores. 

In addition, factor scores derived from micro-environment assessment 
data contributed varying amounts to total predictability of poet-test and 
change scores in combination vith pre-test predictor scores in a steori 3 e 
multiple (linear) regression analysis. 

Discussion 

One additional way of viewing these data concerns what they say about 
the actual programs which were described via this procedure. JJhila the 
data were not analyzed for cla63roon similarities and differences, the general 
picture is one of homogeneous inactivity. Means for Location; Main Room 
(74.%) and Support: Furniture (54%) for all children in all ten programs 
support this Motion. The lack of Coordinated Behavior (35%) and Persistence: 
Involved Sane (75%) also lends support to this, . along v?ith Teacher's Choice 
(64%) and Class Intact (31%). The relatively high use of Sanction; Involve- 
ment (44%) tends to eive a picture of attempts by adult6 to (externally) 
motivate the children. 

Work is currently in process to reanalyze these data to provide composite 
pictures of classrooms in quantitative as well as quolitlve terms. Data 
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collccted but not included in t.ii3 study ere also being examined for 
for inclusion in this extended analysis. Cthor analysis "ill examine 
different ways of scoring the data, possible curvilinearity in regression, 
and additional criterion scores. 

VJhile several concerns about individucl-child-based (nicro-envtronnent) 
program assessment continue, more advantages than disadvantages are seen, 
as thi3 phase of procedure development and validation cones to a close. 

The advantages are both theoretical and practical. On the theoretical 
side, opportunity is afforded for determining the actual _ncounters a 
child has instead of assuning that a Set of inruts arc equally available 
for all children - an assumption made throughout by most methodologies 
which arc teacher based - either observation or self-rer-ort (see Doypera 
and Lay, lS6s). In addition, by refocusing observations involving a given 
child 0ll the factors which either impinge on him or serve as a medium 
supportin'; his behavior, a clearer picture of the "program" emerges than 
when child-behavior alone, or interactions are the unit of description. 

This refocusing thus allows for a direct conceptualization and assessment 
of the program as independent variables impinging on a child. In this 
regard, this approach would 3_rve well as a quality control-device under 
conditions where interventions are assumed to be experimentally present 
yet the extent to which tr.e treatment is present for any given child is 
an unknown. 

There arc three practical advantages. The observation system can be 
used with minimal training, by relatively naive observers. The system, 
with some additional work can be used in any Setting (e.g. parent and child) 
involving a child in a natural environment, thus facilitating comparisons 
for a child or children between environments concurrently and/or across 
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tine. T.ie procedure also, vita .iOt much additional work, can utilize a 
machine acorable recording sheet thus Laving houro of hand tabulating. 

As usjd in this developmental form, SuV-.ral difficulties arc s.i.n. 
Too much vaa included vrliich was not particularly relevant. This factor 
undoubtedly put a strain on the observers and dir_ctly and/or indirectly 
influenced item reliability. 

The number of observations required to tainiraumally stabilize a base- 
rate clearly (retrospectively) varies by outting, child, and itnes. This 
factor nay also contribute to reliability problems. 
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A. Recording Sheet 

B. Intercorrelations of 33 Environemnt Items 

C. Factor Loadings for 33 Environment Items on the Seven Factors 

D. Intercorrelations of twenty-one Predictor Variables 

E. Raw Score Means and Standard Deviations of Eight Criterion VAriablos 

F. Int^rcorrelations of Eight Criterion Variablss 
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APPENDIX C 

Rotated Factor Loadings for 33 Environmental Variables 
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Appendix D 

Intercorre let ion* of Twenty -One Predictor Variable* (N«67) 
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Appendix E 

Raw Score M^ans and Standard Deviations of Test-Criterior Variables 
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Intercorrelations of Eight Criterion Variables 
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